good (1.0), and for the "degree of certainty" response,
very strong (0.9), strong (0.5), and moderate (0.1). (The
scales selected reflect the closer correlation between the
"belief in measure" response and the concept of validi-
ty.) Multiplying the score for the first response by the
score for the second yielded a validation score for each
measure. Those scores ranged from a low of -0.72
(-0.8 for poor belief times 0,9 for a very strong degree
of certainty) to a high of -1-0,9 (1.0 for good belief times
0.9 for a very strong degree of certainty).

By averaging validation scores across all respondents
who evaluated a particular measure, researchers derived
a group validation score for that measure. The program
coordinators recommended only measures averaging
4-0.05 or higher for inclusion in a measurement system.
That cutoff point reflected at least a satisfactory belief
in the measure with a strong degree of certainty. Figure
3 lists the quality measures of staff productivity that
survived this cutoff, in descending order of validation
rating, for the first two key deviations. The range of
scores under a deviation reflects the rankings obtained
from the validation group of managers, That group
considered a total of 29 quality measures valid.

Through follow-up interviews with both manage-
ment and staff, researchers assessed the immediate
benefits of the measures development process to the
participating organization. Highlights of those benefits,
reported independently by the two groups, included the
following.

Participants agreed that the project provided a forum
for constructive interchange of ideas, thereby opening
communication channels and affording a vehicle for
bringing problems to the attention of top management.
Division personnel considered this benefit particularly
important because management of the organization had
changed recently, but due to the press of everyday busi-
ness, management had not been able to do a systematic
study of organizational needs. Also, exposure of
branch-level personnel to the experiences of other
branches in the division helped broaden the perspective
of the participants.

In addition, the process demonstrated the steps in-
volved and hindrances encountered in executing
assignments. Given the constantly changing demands of
a largely unprogrammed workload, no one had previ-
ously tried to rationalize the process. This study
highlighted recurring stumbling blocks, regardless of
the request or branch involved, and thus enabled man-
agement to remove some of the obstacles to speedier
accomplishment.

Stronger group identity was another benefit. Up until
the time of the study, branches only infrequently inter-

acted with one another or collaborated on projects,
because the nature of their duties rarely required such
working relationships. The physical location of the
branches on different floors of a large office complex
had further hindered formation of a division identity.

The project also established a baseline for defining in-
dividual job requirements and performance goals more
precisely. Before the study, top management's primary
criterion in assessing performance had been timely ac-
complishment of assigned projects. The project gave
management more than 30 measures to use in develop-
ing the individual staff objectives that a new perform-
ance appraisal system required.

Finally* the pilot program proved the feasibility of
developing measures of the quality of staff productivity.
Although developed for one division, the measures ap-
pear, after preliminary examination, to have applicabili-
ty to other organizations. Their appropriateness and
validity within any one or across multiple staff units,
however, need further investigation and testing. The
final determination of which productivity measures are
both applicable and feasible will have to occur at the
organizational level at which they are being used. This
step will ensure that the measures selected are not only
appropriate but that the organizations are committed to
the measures as well.
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